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ABSTRACT 


The  recent  literature  contains  theorems  improving  on  both  the  Standard 
Bonferroni  inequality  (Hoover  (1988-a))  and  the  Sidak/Slepian  inequalities 
(Glaz  and  Johnson  (1984)).  The  application  of  these  improved  theorems  to  upper 
bounds  for  non  coverage  of  simultaneous  confidence  intervals  on  multivariate 
normal  variables  is  explored.  The  improved  Bonferroni  upper  bounds  will  always 
apply,  while  improved  Sidak/Slepian  bounds  only  apply  to  special  cases.  The 
improved  Sidak/Slepian  upper  bound,  if  it  applies,  is  always  superior  to  the 
equivalent  improved  Bonferroni  bound.  This  improvement,  however,  is  not  great 
when  both  methods  are  used  to  determine  upper  bounds  for  Type  I  error  in  the 
range  of  .01  to  .10.  It  is  shown  that  improved  Sidak/Slepian  bounds  will  apply 
to  Normal  Markov  Processes,  a  commonly  occurring  and  easily  identifiable  class 
of  multivariate  normal  variables. 
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1.  INTRODUCTION 

Recently,  there  has  been  considerable  interest  in  improving  on  the 
Bonferroni  and  Sidak/Slepian  upper  bounds  for  simultaneous  coverage  of 
multivariate  normal  confidence  intervals  (Hunter  (1976),  Glaz  and  Johnson 
(1984),  Hoover  (1988-a)).  Let  X  =  (x^,...,Xnj  be  random  variables  with  a  joint 
multivariate  normal  distribution.  Define  C.  as  some  constant  greater  than  zero 

1  2 

for  i=l,...,n.  Often  C.  will  be  a.  •  C  where  a.  is  the  variance  of  X,  and  C  > 

1  1  -L  1 

0.  Let  i=l,...,n  be  events  defined  as  follows:  CASE  I  -  (Two  sided 
symmetric  confidence  interval):  E^  is  the  event  |Xj  |  ^  (-  C±l  cp.  CASE  II  - 
(one  sided  upper  limit  interval):  E^  is  the  event  X^  $  (-°»,  C^).  CASE  III 
(one  sided  lower  limit  interval):  E^  is  the  event  X^  ^  (-C^,  ®). 

n  r  -j 

Let  E?  be  the  complement  of  event  E.  and  E  =  U  E.  .  Finally, 

1  1  i=l  L  1J 

define  ?i  =  P(E.},  P?  =  P{E^)  =  (1-P.)  and  Pg  =  P{E}. 

Usually,  due  to  limitations  on  numerical  integration,  it  will  be 

impossible  to  calculate  Pg  exactly.  Therefore,  in  order  to  be  conservative,  it 

is  desired  to  calculate  U  where  U  is  an  upper  bound  for  Pg.  The  closer  U  is  to 

PE,  the  better  the  conservative  bound  is.  The  importance  of  having  good  upper 

bounds  U  arises  from  the  many  applications  of  simultaneous  confidence  intervals 

(See  Khatri  (1967);  Barlow  and  Proschan  (1975);  and  Bauer  and  Hackel  (1985)). 

Sometimes,  it  may  be  of  interest  to  obtain  L,  a  lower  bound  for  P£. 

The  Bonferroni  and  Sidak/Slepian  upper  bounds  (Ug  and  Ug  respectively) 

and  the  Slepian  lower  bound  (L<.)  are  now  presented.  Let  X,  E^,  E,  P^  and  Pg  be 

as  defined  above.  Let  p. 4  be  the  correlation  of  X.  and  X.  l<i<j<n;  then 

(1) 

intervals) 


(2) 

ir  *-ervals) 

(3) 

II  and  CASE  III  one  sided  confidence  intervals) 


1  J 

Bonferroni  (1936)  Inequality  (Holds  for  all  types  of  confidence 


PE  <  uB  =  Z  P.  • 

i=l 

Sidak  (1968)  Inequality  (Holds  for  Case  I  two  sided  confidence 


PE  <  us  =  1  -  n  pJ  • 

1=1 


Slepian  (1962)  Upper  and  Lower  Bound  Inequalities  (Holds  for  CASE 


-2- 


If  pjj  >  0  for  all  i,j  then  Pg  <  Ug  *  1 


n 

n 

i=l 


n 

If  p.  .  <0  for  all  i,j  then  P_  >  Lc  =  1  -  II  P?  . 
ij  -  B  5  i=l  1 

Note  that  the  Slepian  upper  and  Sidak  bounds  are  identical  except  that 

the  Sidak  bound  holds  for  two  sided  confidence  intervals  while  the  Slepian 

upper  bound  holds  for  one  sided  intervals. 

It  has  been  proven,  (Dunn  (1958)),  that  Ug  in  (2)  and  (3)  is  less  than 

(better  than)  the  corresponding  Ug.  It  is  also  clear  that  Ug  is  non 

degenerate,  Ug  <  1  while  Ug  can  be  degenerate,  Ug  >  1  is  possible. 

Neither  Ug  nor  Ug  uses  the  intersection  structure  within  (E^,  E2,  ...» 

E  ).  That  is,  Un  and  Uc  each  produce  the  same  values  for  n  independent  events 
n  os 

as  they  do  for  n  positively  correlated  events.  This  is  true  even  though  Pg  can 
be  much  lower  for  n  positively  correlated  events  than  it  is  for  n  independent 
events.  For  instance,  suppose  n  =  6,  and  P^  =  0.5  for  i  *  1,...,6.  If 
Ej , . . . , Eg  are 

6 

jointly  independent,  then  P_  »  1  -  II  (P?)  =  .2649;  while  under  the  most 

E  i.l  1 


=  Pj  =  0.5.  However,  in  both 
of  the  cases  described  above,  the  bound  Un  is  6(.05)  =  .30  and  the  bound  Uc,  if 
it  applies,  is  1  -  (.95)°  =  .2649. 

In  the  above  example  and  in  general,  the  bounds  Ug  and  Ug  approximate  Pg 
well  when  the  E.^  are  independent,  but  do  more  poorly  when  the  X^^  are 
correlated.  A  similar  problem  holds  for  Lg.  Two  methods  that  can  incorporate 
interaction  (collinearity)  between  subsets  of  size  k  of  the  E^  to  produce 
sharper  bounds  for  Pg  have  recently  been  proposed.  The  first  method,  presented 
in  Section  2,  is  an  extension  of  the  Bonferroni  theorem  while  the  second 
method,  presented  in  Section  3,  extends  the  Sidak/Slepian  results. 


extreme  correlation:  E^  =  E2  =  •  •  •  =  EgJ,  Pg 


2.  THE  EXTENDED  BONFERRONI  METHOD 

Theorem  2.1  The  Extended  Bonferroni  Bound  (Hunter  (1976)  k=2,  Hoover  (1988-a) 
k>2) 

Let  X^,  E^,  E  and  Pg  be  as  defined  in  the  first  paragraph  of  section  1. 
Let  k  be  an  integer:  l<k£i.  Suppose  that  it  is  possible  to  integrate  over  k 
or 
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fewer  dimensions  or  otherwise  determine  P 


{  J|jl  Ei 

U- j-k+1 


i=j-k+l 


for  j=k, 


Then 


PE  *  UB,k  "  P 


U  E. 
=1  1 


£ 

j-k+1 


(  »  Eil  ■ p  { 

U-J-k.l  )  U-j-k 


The  proof  follows  from  Theorem  1  from  Hoover  (1988-a)  with  the  set 
containing  {j-1,  j-2,  j-k+1}  . 

This  theorem,  like  the  standard  Bonferroni  bound,  is  distribution  free. 
The  events  E. ,  E^,...,  Er  can  be  any  events  (not  merely  those  defined  by 
confidence  intervals  on  multivariate  normal  variables)  and  the  inequality  (4) 
will  hold.  When  the  E ^  are  as  defined  in  Section  1,  it  is  currently 
computationally  possible  to  integrate  over  multivariate  normal  densities  of  up 
to  4  dimensions,  (see  Schervish  (1984)),  and  thus  implement  this  theorem  for  k 
<  4.  Undoubtedly  as  computers  and  computational  methods  improve,  it  will 
become  possible  to  implement  this  theorem  for  even  larger  values  of  k. 

When  k=l,  Theorem  2.1  reduces  to  the  Standard  Bonferroni  Bound.  It  is 
shown  in  Hoover  that  U0  always  is  monotonically  decreasing  (improving)  as  k 
increases.  However,  the  extended  Bonferroni  upper  bound,  like  the  Bonferroni 
upper  bound,  can  be  degenerate  (See  Table  6.1). 


3.  THE  EXTENDED  SIDAK/ SLEPIAN  METHOD 

The  extended  Sidak  and  Slepian  bounds  will  now  be  presented.  These 
bounds  will  hold  only  for  those  normal  (and  other)  distributions  which  have 
certain  MTP2  or  MRR2  properties.  Definitions  3.1,  3.2  and  3.3  are  given  to 
define  these  MTP2  and  MRR2  properties. 

Definition  3.1  (Karlin  and  Rinot  (1980-a))  A  real  function  (or  joint 
density)  of  two  variables  f(W,Y)  is  Totally  Positive  of  Order  Two,  (tP2)  if  for 
all  fixed  values  w^<W2  and  y^<y2> 

(5)  f(w1,y1)  f(w2,y2)  -  f(Vj,y2)  f(w2,y1)  >0 

Definition  3.2  (Karlin  and  Rinot  (1980-a))  A  real  valued  function  (or 
joint  density)  of  n  variables  f(X^,...,Xn)  is  Multivariate  Totally  Positive  of 
Order  Two,  (MTPjjf  if  for  any  pair  of  variables  X^  and  X^ ,  the  function  f(Xit 
Xj)  with  the  remaining  variables  fixed  is  TP2. 
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Definition  3.3  (Karlin  and  Rinot  (1980-b)).  The  bivariate  function  of 
Definition  3.1  is  Reverse  Rule  of  Order  Two  (RR2)  and  the  multivariate  function 
of  Definition  3.2  is  Multivariate  Reverse  Rule  of  Order  Two  (MRR2)  if  the 
direction  of  the  inequality  in  (5)  is  reversed. 

A  pair  of  variables  (X^,  X2)  is  said  to  be  TP2  (RR2 )  if  its  joint  density 
is  TP2  (RR2)  respectively.  A  sequence  of  variables  (X^,...,  Xn)  is  said  to  be 
MTP2  (MRR2)  if  its  joint  density  is  MTP2  (MRR2)  respectively. 


Theorem  3.1  The  Extended  Sidak/Slepian  Bounds  (Glaz  and  Johnson  (1984)) 

Let  X.,  E.,  E,  and  P-  be  as  defined  in  the  first  paragraph  of  section  1, 

11  Et 

with  the  exception  that  X  is  now  allowed  to  have  any  distribution  not  only  the 
multivariate  normal.  Let  k  be  an  integer,  l<k<n.  Assume  that  it  is  possible 


to  integrate  over  k  dimensions  or  otherwise  determine  P  <EV 


j-1 

n 

i=j-k+l 


Then 


(a)  (Extended  Slepian  Upper  Bound)  If  X  is  MTP2  it  follows  when  the 
events  E..  are  either  all  one  sided  upper  limit  intervals  or  all  one  sided  lower 
limit  intervals  that 


P 


E 


1-P 


n  pJe? 
j=k+l  l J 


j-1 

n 

i=j-k+l 


(b)  (Extended  Slepian  Lower  Bound)  If  X  is  MRR2  it  follows  when  the 
events  E^  are  either  all  one  sided  upper  limit  intervals  or  all  one  sided  lower 
limit  intervals  that 


P 


E 


n  pIe? 
j=k+l  l  J 


j-1 

n 

i=j-k+l 


(c)  (Extended  Sidak  Bound)  If  |x|  is  MTP2  it  follows  when  the  events  E^ 
are  all  two  sided  symmetric  confidence  intervals  that 

j-1 

n 

i=j-k+l 


The  proofs  of  statements  (a),  (b)  and  (c)  follow  from  Theorems  2.3  and 
2.8  in  Glaz  and  Johnson  (1984)  when  one  realizes  that: 

(i)  P{Xj  e  (-Cj,  C^)}  =  P{  |X^  |  e  (-®,  Cj)}  (an  infinite  interval) 
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(ii)  If  Yk  is  a 


Cover 
pper 


j  bound  for  pj^fl  then  1-Yk  is  a  (j^gy)  bound 


for  PE 


Note  that  when  X  is  normal,  |x|  will  never  be  MRI^  and  thus  there  is  no  "Sidak 
like"  lower  bound  for  Pg  in  the  two  sided  case. 

For  k=l,  the  bound  in  Theorem  3.1  is  equivalent  to  the  Sidak/Slepian 
Bounds.  Us  k  like  Ug  is  non  degenerate  and  is  monotonically  decreasing  with  k, 
while  Lg  k  is  monotonically  increasing  with  k;  see  Glaz  and  Johnson  (1984).  As 
mentioned  earlier,  the  extended  Sidak  and  Slepian  bounds  do  not  hold  for  all 
normal  distributions.  Section  5  describes  in  detail  some  important 
distributions  for  which  they  do  hold.  Finally,  Theorem  3.1  can  be  applied  to 
multivariate  t  distributions;  see  Glaz  and  Johnson  (1984). 


4.  EXTENDED  SIDAK/SLEPIAN  BOUND  IS  SUPERIOR  TO  EXTENDED  BONFERRONI  BOUND 

Two  methods  have  been  proposed  for  obtaining  upper  bounds  which  utilize 
interactions  between  subsets  of  events,  namely  the  extended  Bonferroni  (Ug  k) 
and  the  extended  Sidak/Slepian  (Ug  k)  bounds.  It  is  therefore  of  interest  to 
know  which,  if  either,  gives  better  results.  The  next  theorem  shows  that 
whenever  the  extended  Sidak/Slepian  method  applies,  it  produces  better  upper 
bounds  than  does  the  equivalent  extended  Bonferroni  Method. 

Theorem  4.1.  Superiority  of  Ug  ^  over  Ug  Glaz  (1988),  Hoover  (1988-b) 

Let  X,  Ej,  Pg,  Ug  k  and  Ug  k  be  as  defined  in  Theorem  3.1.  Let  E  be  the 
covariance  of  X.  Also  assume  that  X  (or  |x|)  and  Ej  have  the  required 
properties  for  Theorem  3.1  to  apply.  Then  for  any  fixed  k: 

(i)  US,k  ”  UB,k  =  PE  for  k’n 

(ii)  Ug  k  <  Ug>k  for  k<n 

(iii)  If  X  has  a  multivariate  normal  (or  t)  distribution  and  the 
covariance  (  £  )  is  full  rank,  then  Ug  k  <  Ug  k  for  k  <  n. 

Proof  -  This  Theorem  has  been  independently  proven  by  Glaz  (1988)  and  Hoc”er 
(1988-b).  The  proof  from  Hoover  (1988-b)  is  in  the  appendix. 

Not  only  is  Ug  k  superior  to  Ug  k  for  any  fixed  value  of  k  <  n,  but  also 
U<,  .  is  computationally  no  more  difficult  to  calculate  than  is  Un  ..  This  is 

r  j  cl  f  j  1 

because  P<  n  E.  >  *  1  -  P  <  U  Therefore,  whenever  the 

l  i-j-k+1  1  J  l  i-j-k+1  1  J 
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distributional  conditions  are  met  for  using  the  extended  Sidak/Slepian  upper 
bound,  this  bound  should  be  used  instead  of  the  corresponding  extended 
Bonferroni  upper  bound. 

5.  SOME  IMPORTANT  DISTRIBUTIONS  TO  WHICH  EXTENDED  SIDAK/SLEPIAN  BOUNDS  APPLY 

Since  it  has  been  proven  that  whenever  the  extended  Sidak/Slepian  upper 
bound  is  applicable,  it  gives  better  results  than  does  the  comparable  extended 
Bonferroni  bound  and  since  an  extended  Slepian  lower  bound  exists,  it  is  of 
interest  to  identify  important  situations  in  which  the  extended  Sidak/Slepian 
bounds  apply. 

The  extended  Slepian  upper  (lower)  bounds  require  that  the  variables  (X) 
have  an  MTP2  (MRR2)  structure.  It  follows  from  Bolviken  (1982)  and  Karlin  and 
Rinott  (1980-a),  that  if  X  -  N(u,  E)  then  X  is  MTP2  iff  >  0  for  i*j  where 

is  the  partial  correlation  of  X^  and  X^  given  all  other  variables  in  the 

vector  X.  Karlin  and  Rinot  (1980-b)  give  sufficient  conditions  on  E  for  a 
multivariate  normal  vector  X  to  be  MRR2. 

The  extended  Sidak  bound  requires  |x|  to  be  MTP2.  It  follows  from  Karlin 

and  Rinot  (1980-a)  and  Bolviken  (1982)  that  if  X  is  a  multivariate  normal 

vector,  then  jx[  is  MTP2  iff  there  exists  some  diagonal  matrix  D  with  |Dii  |  = 

1,  i=l,...,  n,  such  that  Y  =  D  X  and  p. .y  >0  for  all  i,j  where  p.^  is  the 
partial  correlation  of  Yj  and  Yj  given  all  other  variables  in  the  vector  Y. 

It  turns  out  that  many  multivariate  normal  processes  of  interest  have  the 
above  properties.  The  next  theorem  shows  that  multivariate  vectors  for  which 
each  successive  component  is  a  successive  time  realization  of  a  Markov  process 
have  MTP2  and/or  MRR2  properties. 

Theorem  5.1  MTP^  and  MRR2  Properties  of  Normal  Markov  Processes. 

Let  X  =  (Xj,...,Xn)  be  a  Normal  Markov  Process,  that  is:  X^,  X2,...,  Xr  are 
successive  outcomes  of  a  Markov  Process  for  i=l,...,n  and  (X^,...X  )  has  a 
multivariate  normal  distribution.  Then 

(a)  |X|  is  MTP2 

(b)  if  p^  >  0  for  i=l,...,n-l  then  X  is  MT?2* 

(c)  if  p^  <  0  for  n-1  then  X  is  MRR2. 

Proof 

(a)  Since  |X^+^  |  =  |-  X^+^  |  and  at  least  one  of  the  following  {Corr(X^, 
X.+i),  Corr  (X.  -  X^+^)}  is  non  negative  for  i=l,...,n-l,  it  follows  from 

Bolviken  (1982)  that  (|X.  |,  |X.+1|)  is  IP2-  Since  (Xj,  X2,...,Xn)  is  a  Markov 
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chain,  (|X^|,  |Xj  |Xn|)  *s  a^so  a  Markov  chain.  Therefore,  (|X^|, 

IX2  |Xn|)  is  a  Markov  chain  with  TP2  transition  probabilities  and  by 

proposition  3.10  in  Karlin  and  Rinot  (1980-a)  it  follows  that  |x|  =  ( |Xj  | , 

|X2  | ,  —  ,  |Xn|)  is  MTP2. 

(b)  Since  Corr  (X^,X^+^)  is  non  negative,  it  follows  from  Karlin  and 
Rinot  (1980-a)  that  (X^,X^+^)  is  TP2.  Therefore,  X^,X2»...,Xn  is  a  Markov 
chain  with  TP2  transition  probabilities  and  by  proposition  3.10  in  Karlin  and 
Rinot  (1980-a)  it  follows  that  (X^^,  •  •  •  ,XR)  is  MTP2. 

(c)  Since  Corr  (X^,  X^)  is  nonpositive,  (X^  -  Xi+1)  is  TP2  which 

means  that  (X.,  X.  .)  is  RR-.  Therefore,  X- ,  X0,...,  X  is  a  Markov  chain  with 
i  1+1  2  1  2  n 

RR2  transition  probabilities;  so  by  a  slight  modification  of  proposition  3.10 
in  Karlin  and  Rinot  (1980-a),  it  follows  that  (X^,  X2,  ...»  Xn)  is  MRR2. 

There  are  many  normal  Markov  Processes  which  are  of  interest  in  practice. 
Some  important  examples  are  given  in  Section  6.  The  extended  Bonferroni  upper 
bound  has  previously  been  applied  and/or  recommended  for  these  examples  for 
which  a  superior  extended  Sidak/Slepian  upper  bound  could  be  applied.  In 
Section  6,  it  will  be  shown  how  much  improvement  the  extended  Sidak  upper  bound 
gives  over  the  equivalent  extended  Bonferroni  upper  bound  for  these  examples. 
Extended  Slepian  bounds  are  not  considered  since  in  practice  one  sided 
confidence  intervals  are  not  of  as  much  interest  as  are  two  sided  confidence 
intervals. 

6.  IMPROVEMENTS  USING  Ug  k  GIVES  OVER  USING  Ug  FOR  SELECTED  NORMAL  MARKOV 
PROCESSES 

The  extended  Sidak  bound  is  compared  to  the  equivalent  extended 
Bonferroni  bound  for  the  following  three  examples  of  normal  Markov  processes. 
6.1  AR(1)  TIME  SERIES 

Consider  (X..,...,X  )  as  n  successive  observations  of  a  stationary  time 
1  2n  2 

series  with  X^  ~  N  (0,p  )  i=l,...,n,  and  c  known.  Also  assume  Xj+^  *  p  •  X^  + 

ei  for  i*l,...,n-l  where  0<p<l  and  ~  N(0,  cr^(l-p^)).  Then  X  =  (X^,...,Xn) 

is  an  AR(1)  Markov  process  as  described  in  Box  and  Jenkins  (1976)  and  X  has  a 

2  2 

multivariate  normal  distribution  with  Var(Xp  =  cr  and  Cov(X^,X^  +  ^)  =  pa  .  By 
Theorem  5.1,  |X|  is  MTP2  and  therefore,  by  Theorem  .1.  the  extended  Sidak 
method  applies  to  two  sided  confidence  intervals  involving  X.  Since  the 
covariance  of  X  is  full  rank,  by  Theorem  4.1,  the  extended  Sidak/Slepian  upper 
bound  is  better  than  the  extended  Bonferroni  bound.  Table  6.1  compares  Ug  ^ 
and  Ug  ^  with  Ug  ^  and  U3  ^  on  AR(1)  processes  using  selected  values  of  n,  p 
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TABLE  6.1  * 


Extended  Sidak 

and  Extended 

Bonferroni 

Upper 

Bounds  for 

Non  Simultaneous 

Coverage  of  Two 

Sided  Confidence  Intervals  on 

AR( 1 )  Time 

Series 

Variables  where 

C.  = 

l 

C. a  for  i= 

1 , . . . ,n. 

C  = 

1.96 

k=2 

k=3 

P 

n 

UB,2 

US,2 

UB,3 

US,3 

.3 

5 

0.23047 

0.21801 

0.22381 

0.21781 

10 

0.45606 

0.38689 

0.43831 

0.38646 

50 

>  1 

0.91244 

>  1 

0.91207 

100 

>  1 

0.99231 

>  1 

0.99225 

.7 

5 

0.18368 

0.17689 

0.17553 

0.17248 

10 

0.35104 

0.31194 

0.32900 

0.30207 

50 

>  1 

0.83596 

>  1 

0.82132 

100 

>  1 

0.97627 

>  1 

0.96746 

.9 

5 

0.13141 

0.12883 

0.12220 

0.12125 

10 

0.23317 

0.21823 

0.20863 

0.19996 

50 

>  1 

0.67125 

0.90005 

0.62237 

100 

>  1 

0.88867 

>  1 

0.85225 

.99 

5 

0.07631 

0.07604 

0.07155 

0.07147 

10 

0.10920 

0.10759 

0.09652 

0.09579 

50 

0.37235 

0.32415 

0.29625 

0.26872 

100 

0.70129 

0.52252 

0.54590 

0.43915 

p 

n 

k=2 

UB,2 

C  =  3.00 

US,2 

k=3 

UB,3 

US,3 

.3 

5 

0.01331 

0.01327 

0.01326 

0.01324 

10 

0.02657 

0.02632 

0.02644 

0.02624 

50 

0.13265 

0.12469 

0.13187 

0.12430 

100 

0.26526 

0.23381 

0.26365 

0.23310 

.7 

5 

0.01166 

0.01163 

0.01148 

0.01146 

10 

0.02286 

0.02268 

0.02385 

0.02225 

50 

0.11245 

0.10674 

0.10961 

0.10440 

100 

0.22444 

0.20172 

0.21864 

0.19745 

.9 

5 

0.00861 

0.00860 

0.00820 

0.00819 

10 

0.01601 

0.01593 

0.01489 

0.01484 

50 

0.07517 

0.07265 

0.06846 

0.06471 

100 

0.14912 

0.13897 

0.13543 

0.12722 

.99 

5 

0.00469 

0.00469 

0.00438 

0.00437 

10 

0.00717 

0.00716 

0.00631 

0.00631 

50 

0.02704 

0.02676 

0.02189 

0.02172 

★ 

100 

0.05188 

0.05070 

0.04137 

0.04066 

Numerical  Integration  to  a  relative  accuracy  of  0.00001  done  using  Shervish's 
(1984)  program 
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6.2 

A 


SEQUENTIAL  TESTING  USING  MEANS  OF  NORMAL  VARIABLES 


2  2 

Let  be  iid  N(y,  o  )  with  a  known. 


Suppose  it  is  of  interest  to  test 
Hq:  y=0  and  also  that  it  is  expensive  or  inconvenient  to  sample  the  X^.  Then 
one  approach  for  testing  H  involves  a  sequential  sampling  of  the  X^  with  at 

°  1  j 

each  step  calculating  Y.  =  — r  Z  X.  for  j=l,...,n.  Also,  at  each  step,  a  two 

J  ff*3  i  =  l  1 

sided  confidence  interval  for  y  of  the  form  Y^  -  C •  /Var  ( Y.. )  <  y  <  Y^  + 

O /Var(Y^ )  where  C>0  is  constructed.  Hq  is  rejected  immediately  and  sampling 


is  stopped  at  the  first  step  j  where  the  confidence  interval  does  not  include 
zero.  If  all  confidence  intervals  include  zero,  then  Hq  is  accepted. 

Bauer  and  Hackel  (1985)  suggest  using  Ug  2  as  an  upper  bound  for  the 
type  I  error  because  of  the  high  correlation  between  Y^  and  Yj  +  ^  which  equals 

(jii)  .  But  since  Y  =  (Y^jYj, . • • ,Yn)  is  a  normal  Markov  process  with  a  full 


rank  covariance,  then  by  Theorems  5.1  and  4.1,  Us  2  will  give  even  better 
upper  bounds  for  type  I  error.  Table  6,2  compares  U0  2  and  Ug  2  for  various 
values  of  n  and  C. 

TABLE  6.2* 

Extended  Sidak  and  Extended  Bonferroni  Upper  Bounds  for  Type  One  Error  of 
Sequential  Testing  Using  Means  of  Normal  Variables  (See  Section  5.2) 


n 

C=1 

.96 

C=2 

.50 

c=. 

3.00 

UB,2 

US,2 

UB,2 

US,2 

UB,2 

US,2 

10 

0.23785 

0.22229 

0.06724 

0.06592 

0.01616 

0.01608 

20 

0.35794 

0.31520 

0.10302 

0.09921 

0.02513 

0.02489 

50 

0.59846 

0.46895 

0.17493 

0.16255 

0.04325 

0.04245 

80 

0.77248 

0.55809 

0.22705 

0.20563 

0.05640 

0.05500 

100 

0.87067 

0.60159 

0.25647 

0.22896 

0.06283 

0.06201 

*  Numerical  Integration  to  a  relative  accuracy  of  0.00001  done  using 
Schervish's  (1984)  Program. 

6.3  DETECTION  OF  A  CHANGE  POINT  IN  A  NORMAL  SERIES 

2  2 

Under  Hq,  Let  Xj,...,X  be  independently  distributed  N(y,<r  )  with  a  known. 

While  under  H^,  let  the  n  observations  be  independent  realizations  of  the 

.  2  2 
senes  X^...,Xm_^  and  Xm,...,  Xn  distributed  as  N(y^,a  )  and  N(y2,  c  ) 

respectively.  The  "Change  Point"  m  is  unknown.  To  test  H  vs.  H.,  confidence 

intervals  of  the  form  (W^  -  C(var(W^),  W^  +  C(var(W^))  are  constructed  about 

the  standardized  likelihood  ratio  statistic 
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V. 

J 


j  n 

Z  X./j  -  Z  X. / (n-j ) 
1=1  i=i  +  l 


for  j=l 


,n-l  . 


Hq  is  rejected  if  and  only  if  one  of  the  above  confidence  intervals  does 
not  cover  zero.  Both  Bauer  and  Hackel  (1985)  and  Talvar  (1983)  suggest  using 


U_  -  as  an  upper  bound  for  the  type  I  error  because  of  the  high  correlation 

D  >  Z 

between  and  which  equals  (( j+1) (n^j j)  '  Since  are 


realizations  of  a  normal  Markov  chain  with  a  full  rank  covariance,  then  by 
Theorem  4.1,  Ug  2  will  give  a  better  upper  bound  to  the  type  I  error  than  will 
Ug  2'  Table  6.3  compares  Ug  2  with  Ug  ^  f°r  various  values  of  C  and  n. 

TABLE  6.3* 


Extended  Sidak  and  Extended  Bonferroni  Upper  Bounds  for  Type  One  Error  of 
Testing 

for  a  Change  Point  in  a  Normal  Series 


n 

C= 

1.96 

C=2. 

50 

C=3. 

00 

UB,2 

US,2 

V2 

US,2 

UB,2 

US,2 

10 

0.30629 

0.27531 

0.08348 

0.08129 

0.01954 

0.01941 

20 

0.49298 

0.40797 

0.13985 

0.13240 

0.03358 

0.03135 

50 

0.87262 

0.60395 

0.25327 

0.22669 

0.06212 

0.06042 

80 

>  1 

0.70358 

0.33538 

0.28845 

0.08284 

0.07975 

100 

>  1 

0.74822 

0.38170 

0.32108 

0.09454 

0.09048 

Numerical  integration  to  a  relative  accuracy  of  0.00001  done  using 
Schervish's  (1984)  program 

6.4  DISCUSSION 

Define  Ug  ^  as  the  efficiency  ratio  (ER)  of  the  extended  Bonferroni 

upper  bound  relative  to  the  extended  Sidak  upper  bound.  By  Theorem  4.1,  ER  < 

1.  The  closer  this  ratio  is  to  one,  the  better  the  extended  Bonferroni  does 
with  respect  to  the  extended  Sidak. 

In  all  of  the  tables,  the  efficiency  ratio  is  decreasing  in  n  and 
increasing  in  C.  For  instance,  in  Table  5.2,  the  ER  for  n=10  and  C=1.96  is 
0.9345  while  the  ER  for  n=100  and  C=1.96  is  0.6908,  and  the  ER  for  n=10  and 
C«3.00  is  0.9950.  The  lowering  of  ER  with  respect  to  n  is  a  result  of  the 
inductive  nature  shown  in  step  2  of  the  proof  of  Theorem  4.1.  In  this  step,  it 
was  shown  that  [Ug  ^  -  Ug  for  j+l  events  was  larger  than  [Ug  ^  -  Ug  for 


-li¬ 


the  first  j  of  these  events.  The  increase  in  ER  as  C  becomes  larger  is 
probably  related  to  a  similar  phenomenon  observed  with  the  original  Bonferroni 
and  Sidak  bounds.  As  becomes  small,  which  happens  when  C  becomes  large, 
Ug/Ug  -*  1  (see  Dunn  (1958)). 

In  Table  6.1,  p.  .  .  is  equal  to  a  constant  value  p  for  all  i=l,2,...,n- 

1  f  1  +  i 

1.  The  ER  decreases  in  p.  For  instance,  with  C-1.96,  n»10  and  k-2;  the  ER  is 
0.8483  when  p=0.3  and  0.9852  when  p»0.99.  Thus,  the  extended  Sidak  improves  on 
the  extended  Bonferroni  more  when  the  correlation  is  lower  between  the  normal 
variables  involved  in  the  adjacent  events. 

Table  6.1  also  has  values  of  Ug  ^  anc*  3  *n  Edition  t0  values  of  Ug  ^ 
and  Ug  2*  When  C  is  small  (C  =  1.96),  Ug  ^  and  Ug  2  are  often  degenerate 
and/or  even  Ug  ^  is  larger  than  Ug  ^  For  instance,  when  C  =  1.96,  p=0.7  and 
n=50,  both  Ug  ^  an<i  Ug  ^  are  greater  than  one.  Meanwhile,  Ug  ^ ,  which  must  be 
non-degenerate,  is  0.82132  which,  of  course,  is  less  than  Ug 

Most  applied  statisticians  are  interested  in  upper  bounds  for  the 
probability  of  type  I  error  which  are  either  0.01,  0.05  or  0.10.  The  ER's 
observed  in  these  tables  when  upper  bounds  were  between  0.01  and  0.10  ranged 
from  0.8307  to  =  1.0.  In  many  of  these  cases,  the  extended  Sidak  bounds  were 
not  drastically  lower  than  were  the  corresponding  extended  Bonferroni  bounds. 

Something  which  should  be  considered  when  using  multivariate  normal 
approximations  is  that  the  density  being  approximated  may  not  be  MTP2  even 
though  the  normal  approximation  is  MTP2.  In  this  situation,  extended  Sidak 
bounds  may  be  less  appropriate  than  are  extended  Bonferroni  bounds.  Since  Ug  ^ 
and  Ug  k  are  close  together  when  they  are  in  the  range  of  interest  to  applied 
statisticians,  the  investigator  does  not  lose  much  by  using  the  more 
conservative  and  possibly  more  correct  extended  Bonferroni  bound. 
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APPENDIX 


Proof  of  Theorem  4.1 


STEP  1  For  k=n,  Us>k  =  1-P^  E.j  =  P£  =  P^  E.j  = 

and  hence  statement  (i)  of  Theorem  4.1  has  been  proven. 

STEP  2  For  k<n  (By  induction) 

Let  (Xj)  be  the  first  j  elements  of  the  vector  X  for  j=k,  k+1,  ...,n.  It 
is  a  fact  that  if  X  is  MTP2,  then  JL  is  also  MTP2.  (See  Karlin  and 

j 

Rinot  (1980)).  So  define  E(j)  to  be  U  E.  and  P(j)  to  be  P{E(j)}  where  E.  is 

i=l  1  1 

as  defined  in  Section  1.  Let  U^k  and  Ug^k  be  the  extended  Bonferroni  and 

extended  Sidak/Slepian  upper  bounds  for  P(j).  It  will  now  be  shown  that  if 

Us”  S  UB,l  then  i  ■ 


<4r  ■ 1  ■ p  Ej.i 


1  -  p  ej*i 


j 

n 

i=j-k+2 


J 

n 

i=j-k+2 


PCnx  E 


n  p<Je? 
1 1  i-k+i  l 1 


i-l 

n 

h=j-k+l 


Ei  h1  -  us^> 


=  1  - 


pUL  e‘! 


+  p^  n  e" 

U*j-k+2 


Since  by  assumption 

Of  i\  o  f  K 


<  1 


t1  -  u&) 


Since  P< 


J 
U 

U=j-k+2 


f  j+1  c' 

n  e: 

d=j-k+2 


3 

n 

d=j-k+2 


T-  P. 


n  E? 

a=j-k+2  1) 


and 


and  hence  statement  (ii)  of  Theorem  4.1  is  proven. 


STEP  3.  When  the  are  confidence  inte~  ais  for  multivariate  normal  (or  t) 
variables  with  a  full  rank  covariance  matrix,  then  the  inequalities  (*)  and  (5) 
are  strict  and  thus  statement  (iii)  of  Theorem  4.1  follows. 
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20 .  ABSTRACT 


The  recent  literature  j:ontains^ theorems  improving  on  both  the  Standard 
Bonferroni  inequality  (Hoover  (1988-a))  and  the  Sidak/Slepian  inequalities  ^ 
(Glaz  and  Johnson  (1984)).  The  application  of  these  improved  theorems  to  upper 
bounds  for  non  coverage  of  simultaneous  confidence  intervals  on  multivariate 
normal  variables  is  explored.  The  improved  Bonferroni  upper  bounds  will  always 
apply,  while  improved  Sidak/Slepian  bounds  only  apply  to  special  cases.  The 
improved  Sidak/Slepian  upper  bound,  if  it  applies,  is  always  superior  to  the 
equivalent  improved  Bonferroni  bound.  This  improvement,  however,  is  not  great 
when  both  methods  are  used  to  determine  upper  bounds  for  Type  I  error  in  the 
range  of  .01  to  .10.  It  is  shown  that  improved  Sidak/Slepian  bounds  will  apply 
to  Normal  Markov  Processes,  a  commonly  occurring  and  easily  identifiable  class 
of  multivariate  normal  variables.  ■  .  -  - 
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